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Abstract 

In this work we have considered formal power series and partial differential 
equations, and their relationship with Coding Theory. We have obtained 
the nature of solutions for the partial differential equations for Cycle Poisson 
Case. The coefficients for this case have been simulated, and the high ten- 
dency of growth is shown. In the light of Complex Analysis, the Hadamard 
Multiplication's Theorem is presented as a new approach to divide the power 
sums relating to the error probability, each part of which can be analyzed 
later. 
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1 Generating Functions and Operations on 
them 



Let A{z) and B{z) be the two generating functions, in fact two formal power 
sums [2], [3], whose coefficients belong to some field, a„, 6„ e F: 

n>0 

and 

B{z) = J2bnZ'', (2) 

n>0 

The infinite series ^„>o dn^'^: absolutely converges if and only if there is a 
bounding constant M, such that the finite sums X]o<n<7V kn^"'| never exceed 
M, for every G N. It directly follows, that, if Xln>o ^^nZ^ converges for 
some value 2; = 2:0, it also converges for all z with z < zq. Even if the series 
do not converge, the next operations we perform on generating functions can 
be justified rigorously as an operation on formal power series. Then we have 
the following arc satisfied: 

-Right shift 

zA{z)^J2an-iz'', (3) 



n>l 



-Left shift 



-Differentiation 



-Integration 



n>0 



J](n+l)a„+i^", (5) 



n>0 



-Scaling 



-Addition 



r^(t)dt=5]^.", (6) 

•^0 n>l ^ 

^(A^) = ^AX^", (7) 



n>0 



A(z) + S(;^) = 5^(a„ + M^", (8) 



n>0 
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-Difference 



(1 - z)A{z) = ao + 



(9) 



n>l 



-Convolution 



(10) 



n>0 0>fe>n 



-Partial sum 



A{z) 



(11) 



l-z 



n>0 0>fe>n 



2 Introduction 

2.1 The Cycle Poisson Case 

In the next chapter we will consider the Poisson ensemble [1], i.e., the code 
where the following conditions are satisfied: 

-the length of the code is n, 

-the rate is r, 

-all variable nodes have degree two. 

Every edge in the above defined code, is chosen i.i.d. with uniform prob- 
ability for all (1 — r)n check nodes. In the following m = (1 — r)n. 

For the fixed number of variable nodes v, we have the following number 
of constellations: 



The number of such constellations which are stopping sets on t check 
nodes is equal to the following: 



If we have v fixed nodes, having t check nodes of degree all least one, 
and there is no empty stopping-sets, the number of constellations is equal to 





otherwise. 




v!2M(v,t,s). 
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Then, we can derive the error probabihty E[P^-^(G', e)]: 

= {l-ey'A{x=- y = l^z=l), 

(1 — e)((l — r)ny 



where 



A{x,y,z) = J2 r^^-A. ^^^ 



t^S 

■II 

{n — v)\ 



v,t,s 
n m m—t 



v=l t=l s=0 ^ 

is the generating function with coefficients t, s)/{n — v)\. 

For indices, l<t'<n, l<t<m,0<s<m — t, the following is 
satisfied: 

A{v,t,s)s = l,t,s-2)(m-i-s + 2)(m-i-s + l)x{s>2} 

+ l,t,s-l)(m-t-s + l)tx{.>i} 

+ A{v-l,t-l,s){m-t- s + l)sx{s>i}- 

For easy of notations let /c = m + 1. Now, we start with the recurrence 
equation, but considering the generating function: 

G{x,y,z)=Y,Mv.t,s)x''y'z\ (13) 

v,t,s 

except A{x, y, z). 

2.2 Derivation of PDE 

Using rules derived in the previous section, which relate to the operations on 
the generating functions, we get: 
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k{k + l)A{v,t,s-2) = k{k + l)z'^ 



d 

2ktA{v,t,s -2) = 2kyz^—, 



d 

2ksA(v,t,s-2) = 2kz'^(2 + z—), 

az 

t{t-l)A{v,t,s-2) = yV— , 

s{s~l)A{v,t,s-2) = z\2 + Az^ + z^^), 

d (9^ 

2tsA{v,t,s-2) = 2yz^{2— + z——). 



dy dydz ' 



Putting things together, we get: 



z-^G = xlk(k + l)z^ -2kyz^-^-2kz\2 + z-^) 
dz I dy dz 

d d'^ d (9^ 

+ 2/V— + z'{2 + Az— + z^—) + 2yz''{2— + z—^) 
dy^ dz dz^ dy dydz 

d d"^ d d'^ d 

+ myz- zy^^ -y^iTT + z——-) +myz— 

dy dy^ dy dydz dz 

92 ,d d^ 



On the other hand, 

z^G = xh(k + l)z^ -Akz^ + 2z^ 
dz l 

d 

+ {—2kz^ + A.yz^ + myz — yz} — 

dy 

d 

+ { -2kz'^ + Az^ + myz -yz}— 

dz 

+ {yh^-zy^}- 



dy^ 
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Our partial differential equation has just been derived: 

z—G = xziik'^ -?,k^2)z^yi2-k)i2z-l) — 
oz I ay 



+ {2-k){2z'-y)^-ry\y-l) 



dz dy"^ 

where ^ are the partial derivatives, which are applied on 

the function G. 



2.3 Conclusions and Improvement 

What is the capital gain derived from the previous analysis? The crucial 
thing is that, considering the generating function G{x,y,z) over coefficients 
^4(^,^,5), instead of the generating functions A{x,y,z), we have got the 
second order partial differential equation, where x is a parameter. 



3 Partial Equation and Determination of So- 
lutions 

For 2; = we have identity. If z is different than zero, we have to consider: 

a) a; = 0, that will imply ^ = 0, which is the boundary condition for the 
plane {x, y, z) G {(0, A, ^)|A G R, 7^ 0}; 

b) Let us suppose x 7^ and z ^ 0, then we get the following partial 
differential equation: 

1 BG 

- ^ = AGyy + 2BGy, + GG,, + DGy + E'G, + F. (14) 

X oz 

AGyy + 2BGy, + GG,, + DGy + {E' - -)G, + F = 0, (15) 
where polynomials A, B, G, D, E', F are given respectively as: 
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B{y,z) = ^y{2z^-y-z), 

C(y,z) = z(z'^-y), 
D{y,z) = y{2-k)i2z-l), 
E'{y,z) = i2-k)i2z'-y), 
F{z) = {k'^-^k + 2)z. 
Using term — AC we can determine the nature of the solution, [6], [7]: 

{> 0, hyperbohc 
= 0, parabohc 
< 0, eUiptic 

In that case, consider {2BY — AAC. We get the following: 



{2Bf-AAC = y\z^-y-zf-y\y-l)z{z'-y) 

= y'^{Az^ -'iz^ + z^ + y'^ -yz^ -"iyz^ + yz). 

In the aim of determining the nature of the solution, let y = az. With 
this substitution, we are able to divide the y — z plane in disjunct regions, 
where each region belongs to one type of the solution. We have: 

A{B'^ - AC) = y^{Az^ -3z^ + z'^ + y^ -yz^ -3yz^ + yz) 
= z^a'^{{A-a)z'^ -3{l + a)z+l + a + a^). 

Consider the function, f{z) = (4 — a)z'^ — 3(1 + a)z + 1 + a + o? ^ whose 
discriminant is: 



D{oL) = 9(1 + q;)2-4(4-q)(1 + q; + q;^), 
= (a- 1)(4q;^ + q; + 7). 

Now, f{z) = {4:-a)z'^-3{l+a)z+l+a+a'^, also we have {4a'^+a+7) > 0, 
for aeR, and ADpeq = 4(5^ - AC) = a'^z'^f{z). 

Let zi^2 be the roots of the equation f{z) — 0, so we get the following: 

0) a — 0, we have a strictly parabolic case, 

I V2; e R, DpEQ — 0, parabolic 

1) < q; < 1, 

{ V2; e R, DpEQ > 0, hyperbohc 
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2 
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Figure 1: Function f{z) 



2) a = l, 

{z — 3, DpEQ = 0, parabolic 
2; 7^ 3, DpEQ > 0, hyperbolic 




Figure 2: Function f[z) = {z — 3)^ 

3) 1< a < 4, 

z e [zi, Z2], DpEQ < 0, elliptic 
z — Zi\/ z — Z2.I DpEQ = 0, parabolic 
z ^ [zi, Z2], DpEQ > 0, hyperbolic 




Figure 3: Function f{z), E.g. ^1 = 2, ^2 = 4 
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4) a = 4, 

z > LDpeq < 0, elliptic 

z — DpEQ — parabolic 

z <\, DpEQ > 0, hyperbolic 




Figure 4: Function f{z) — —Ihz + 21 

5) a > 4, 

z e [zi, Z'2\, DpEQ > 0, hyperbolic 
z — ziV z — Z2, DpEQ — 0, parabolic 
z ^ [zi, Z2], DpEQ < 0, eUiptic 




Figure 5: Function /(^), E.g. zi — 2, Z2 — 4: 
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Summary, for the nature of the our partial differential equation, we are 
getting the following: 



y 




Parabolic 



Figure 6: The Nature of PDE 
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4 Boundary Conditions 



For the boundary condition, the coefficients A{v, t,s — 0), satisfy the follow- 
ing: 

(1 -^)«A/o,.M„„„rr/„a; 2v, 



A{v,t,s^O) ^ ^ ' J(2^;)!coef{(e^-l-a;)*,x""}. (16) 

Since = {2v — 1)!!, we have: 

A{v, t,s^O)= {2v - l)!!coef{(e^ - 1 - xf, x'^}, (17) 

where m = (1 — r)n. 

In the aim of getting the exponents for the given coefficients, we have 

simulated log ^^'"/^t""^ with increasing t. It is done for m — 100, and t 

[ t ) 

taking the values 1, 2, 3, 4, 5, 10, 30, 20, 40, 50. It is important to notice, that 
given coefficients do not depend on the length and on the rate of the code 
individually, but on m = (1 — r)n. The binomial coefficient ('J*) can be 
derived from the Stirling's formula: 



n\ ^ A/(2n+ -)7r(^-j , (18) 



for n sufficient large. 

On the next page are given simulated values, where g^^\v) is the expo- 
nential factor: 

«"'M=iog -^'"-y)=°' , (19) 

for the appropriate t. 

In the Appendix, it will be shown the simulated exponential factors 
g^^\v), for different t's. 



5 Another views on the problem 
5.1 Complex Analysis 

In this section wc will use another approach, based on Complex Analysis. 
The following problem was considered by Hadamard, [4]. 
Theor em{Hadamard's Multiplication Theorem) 
Suppose that, 

+00 

/(^) = 5]a„z", (20) 

n=0 
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is convergent for \z\ < R, and 

+00 

g{z)=J2bnZ^ (21) 

n=0 

is convergent for l^j < R' and that the singularities of f{z) and g{z) are 
known. 

Consider the function: 

+00 

F(z) = ^a„6„^^ (22) 

n=0 

F{z) is regular for \z\ < RR', and Hadamard's theorem depends on the 
following representation of F{z) as an integral: 

F(^) = ^ f nw)J^Y-^, (23) 

where C is a contour, including the origin, on which \w\ < R, \z/w\ < R' . 
To prove this, write 

.(^)-EM^)". (-) 

n=0 

in the integral, and integrate term by term, as we may by uniform conver- 
gence. We obtain: 



2m Jc WW 



^ 2m J^w''+^ 

+00 



n=0 

the required result. 
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5.2 Returning to Error Probability 

= (i-.rEE(:)-(M.^);^((r3^)'- 



t,S V 



s 

Let X he X — 7^ — — , and consider the sum: 

(l-e)(l-r)2 ' 

^ = EQ-'^(-'^'^)i^-^- (25) 
The following is known, [5], [8], [9]: 

En4 = (l + 4r' for|x|<l, (26) 
J2 ( J = (1 + a;)", for < 1, (27) 
^^vlx", diverge for all x. (28) 

V 

If we could bound the series: 

J2v^-Mv,t,s)x'' (29) 

E^^^x". (30) 

e^h:^.", (31) 

V 

then Hadamard's multiplications theorem could be applied to the given series, 
and some bound could be found. It is very important to remark here, that 
the derived bound would be for a specified t and s. It follows that only tight 
inequalities would satisfy us, because we need to sum over all t and s, in the 
aim of getting Eb- 
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6 Conclusions 



In this work we have shown, how formal power series can be used and how 
one can operate on them, even if the series do not converge. 

We have been analyzing the Cycle Poisson Case, looking for the error 
probability given by the recurrence equation, whose coefficients were depen- 
dent up to a depth two of indices. 

Using appropriate generating functions, wc have derived second order 
partial differential equation. It is shown that x took part like a parameter, 
and the nature of the solution was dependent only on variables y and z, 
but not on x. The nature of the solutions, i.e. how equation behaves is 
completely determined. 

To know how the first coefficients look like, we simulated them. The high 
tendency of growing is obtained, even for small values of t, the coefficients 
are going up to 10^°°. 

Then we suggested totally new approach in the domain of Complex Anal- 
ysis. The problem is divided into parts, looking for two appropriate series, 
whose scalar-multiplication form desired power sum, and try to bound both 
of them. 

It is obvious that for examples whose recurrence equations derive some 
solvable partial differential equation, given method succeeds, otherwise it is 
on us how to approach the solution. 

7 Appendix 

7.1 Diagrams of Exponential Factors 

On the following two pages are shown the simulated exponential factors 
g^''^\v), for different fs, derived in the Section 4, Boundary Conditions. 
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Figure 7: g''^\v) 
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Figure 10: g^^\v) 
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Figure 12: g^^^\v) 
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Figure 13: g^^^\v) 



Figure 14: g^^^\v) 
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Figure 15: g^'^^\v) 



Figure 16: g^^^^i 
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